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DESCRIPTION 



METHOD, APPARATUS AND PROGRAM FOR REPRODUCING A 

MOVING PICTURE 

5 

TECHNICAL FIELD 
[0001 

This invention relates to a method, an apparatus and a program 
which may conveniently be used for raising the replay quality of a 
10 moving picture on the receiver side in case encoded picture data is 
distributed over a transmission channel, in particular, over the Internet 
or a mobile network, having only a narrow transmission band. 
BACKGROUND ART 
[0002] 

15 Among known techniques for compressing/encoding a moving 

picture signal and for efficient transmission thereof over a narrow 
bandwidth, there are, for example ITU-T (International 
Telecommunication Union Telecommunication Standardization Sector) 
recommendations H.263 and H.264, and MPEG (Moving Picture Experts 

20 Group)-4, internationally standardized by ISO (International 
Organization of Standardization)/IEC (International Electrotechnical 
Commission). 
[0003] 

Meanwhile, there are known methods and apparatus in which, 
25 even in case frames are decimated so that only part of picture data are 



displayed, the information pertinent to the motion, inherently possessed 
by moving pictures data, is transmitted to enable demonstration with 
the feeling of actual movement (see Patent Document 1, as an example). 
In this Patent Document 1, a motion generating unit executes weighted 
summation, employing pixel values of plural pixels, based on a motion 
vector, associated with picture data, for each pixel making up the 
picture data, to generate picture data subjected to the processing of 
motion generation and to the processing of imparting the motion to the 
picture data. There is also known a moving picture decoding system 
in which the jerky motion of the reproduced moving pictures may be 
eliminated even in case much time is taken in decoding a picture for 
one picture image due to the low transmission speed of the 
communication network or to larger data volumes of compressed 
moving picture data (see Patent Document 2, for example). In this 
Patent Document 2, a motion compensation circuit generates motion 
interpolation vector data obtained on multiplying by m each reference 
motion vector data, which is obtained by dividing a motion vector of 
each macro-block into n equal parts. The picture data read out from a 
frame memory are sequentially displaced, in accordance with each 
motion interpolating vector data, from frame to frame, and written in a 
display memory. There is also known a moving picture compressing 
apparatus for correctly reproducing the lacking frames on the receiver 
side (see Patent Document 3, for example). In this Patent Document 3, 
a moving picture interpolating unit generates an approximate motion 
curve from the motion vector as found from a neighboring transmission 



frame to re-construct an interpolation frame for interpolation based on 
the distance ratio between neighboring transmission frames. There is 
also known a configuration in which the motion vector of a lacking 
pixel block is estimated and the pixel block is replaced by a 
5 motion-compensated pixel block of the previous frame in such a manner 
that the error-induced deterioration in the picture quality in the input 
signal will be perceived only to a lesser extent by a viewer (see Patent 
Document 4, for example). There is further known a configuration in 
which part of decoded pictures or motion vectors are interpolated from 

10 the previous frame or from the perimeter area of the current frame for 
decreasing the deterioration of a decoded picture in case of occurrence 
of transmission errors in a transmission channel (see Patent Document 
5, for example). There is additionally known a configuration in which 
a suitable interpolated frame is re-constructed between neighboring 

15 transmission frames, from the motion vector, and the processing of 
frame interpolation is carried out for correctly re-constructing a 
lacking frame on the receiver side (see Patent Document 6, for 
example). 
. [0004] 

20 Patent Document 1: JP Patent Kokai Publication No. 

JP-P2000-333131A (page 6, Fig.l) 

Patent Document 2: JP Patent Kokai Publication No. 
JP-A-07-67114 (page 3, Fig.l) 

Patent Document 3: JP Patent Kokai Publication No. 
25 JP-A-07-177514 (pages 3, 5 and Fig.l) 
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Patent Document 4: JP Patent Kokai Publication No. 
JP-A-08-9386 (page 3, Fig.l) 

Patent Document 5: JP Patent Kokai Publication No. 
JP-A-08-79742 (page 3, Fig.l) 
5 Patent Document 6: JP Patent Kokai Publication No. 

JP-A-10-271508 (pages 2, 3 and Fig.l) 
DISCLOSURE OF THE INVENTION 
PROBLEMS TO BE SOLVED BY THE INVENTION 
[0005] 

10 It is well-known that the compression system, such as H.263, 

H.264 or MPEG-4, is of a high compression factor. However, in case 
moving picture contents are distributed over a mobile transmission path 
of a narrow bandwidth, such as, for example, a 28.8 kbps transmission 
path for the PDC (Personal Digital Cellular) mobile phone or a 64 kbps 

15 transmission path for a third generation (3GPP) mobile phone, or over 
the Internet, it is necessary to drastically reduce the number of frames 
of moving pictures per second (number of frames per second or fps), 
for example, to 2 fps for PDC or 5 fps for the third generation (3GPP). 
[0006] 

20 Thus, on the receiving side, information dropout occurs 

significantly in particular for contents with relatively vigorous motion, 
such that it becomes difficult to regenerate sufficient movements, with 
the result that the replay quality is deteriorated significantly. 
[0007] 

25 Accordingly, it is a primary object of the present invention to 



provide a method, an apparatus and a program for reproducing a 
moving picture, whereby the fps on the receiver side can be increased 
to express the motion sufficiently to improve the quality of the moving 
picture even in cases where the transmission speed is low such as on a 
5 mobile transmission path or on the Internet such that no sufficient fps 
(number of frames of moving pictures per second) can be secured. 
[0008] 

It is a second object of the present invention to provide a 
method, a program and an apparatus for reproducing a moving picture, 
10 in which processing is performed only on the receiving side, without 
meddling with processing on the transmitting side, and in which 
pre-existing components, such as en encoder, or the 
compressed/encoded stream, may be used unchanged. 
[0009] 

15 It is a third object of the present invention to provide a method, 

a program and an apparatus for reproducing a moving picture, in which 
it is sufficient to add limited functions on the receiving side and in 
which only a small amount of processing is needed on the receiving 
side. 

20 MEANS TO SOLVE THE PROBLEMS 
[0010] 

For accomplishing the above objects, the invention disclosed in 
the present application is arranged substantially as follows: 
[0011] 

25 An apparatus, in accordance with one aspect of the present 



invention, comprises a decoder, said decoder including a decoding unit 
for receiving a bitstream, obtained on compressing/encoding a moving 
picture, and for restoring a picture image from the bitstream, a 
characteristic parameter extraction unit for extracting a characteristic 
parameter from the picture image restored, and a picture reconstruction 
unit for carrying out preset processing, using a temporally past 
characteristic parameter and/or a temporally future characteristic 
parameter, for restoring a picture image which has not been received. 
[0012] 

An apparatus, in accordance with a second aspect of the present 
invention, comprises a decoder, said decoder including a decoding unit 
for receiving a bitstream, obtained on compressing/encoding a moving 
picture, decoding at least one characteristic parameter from the 
bitstream, outputting the characteristic parameter decoded, and for 
restoring a picture image, using the characteristic parameter decoded, 
and a picture reconstruction unit for carrying out preset processing, 
using a temporally past characteristic parameter and/or a temporally 
future characteristic parameter, for restoring a picture image which has 
not been received. 
[0013] 

An apparatus, in accordance with a third aspect of the present 
invention, comprises a decoder, said decoder including a decoding unit 
for receiving a bitstream, obtained on compressing/encoding a moving 
picture, and for restoring a picture image from the bitstream, and a 
picture reconstruction unit for dividing the picture image into a 
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plurality of blocks, each being of a preset small size, extracting a 
characteristic parameter from the picture image restored, in at least one 
of the blocks, deciding on whether or not preset processing is to be 
carried out, with the use of a temporally past characteristic parameter 
5 and/or a temporally future characteristic parameter, and for 
subsequently restoring a picture image which has not been received. 
[0014] 

An apparatus, in accordance with a fourth aspect of the present 
invention, comprises a decoder, said decoder including a decoding unit 
10 for receiving a bitstream, obtained on compressing/encoding a moving 
picture, decoding at least one characteristic parameter from the 
bitstream, outputting the so decoded characteristic parameter, and for 
restoring a picture image, using the decoded characteristic parameter, 
and 

15 a picture reconstruction unit for dividing the picture image into 

a plurality of blocks, each being of a preset small size, deciding on 
whether or not preset processing is to be carried out, in at least one 
small-sized block, with the use of a temporally past characteristic 
parameter and/or a temporally future characteristic parameter, and for 

20 subsequently restoring a picture image which has not been received. 
[0015] 

An apparatus, in accordance with a fifth aspect of the present 
invention, comprises a decoder, said decoder including a decoding unit 
for receiving a bitstream, obtained on compressing/encoding a moving 
25 picture, and for restoring a picture image from the bitstream, a 
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characteristic parameter extraction unit for extracting a characteristic 
parameter from the restored picture image, and a picture reconstruction 
unit for carrying out interpolation, using at least one of a temporally 
past characteristic parameter and a temporally future characteristic 
parameter, along the time axis, for subsequently restoring a picture 
image which has not been received. 
[0016] 

An apparatus, in accordance with a sixth aspect of the present 
invention, comprises a decoder, said decoder including a decoding unit 
for receiving a bitstream, obtained on compressing/encoding a moving 
picture, decoding at least one characteristic parameter from the 
bitstream, outputting the so decoded characteristic parameter, and for 
restoring a picture image, using the characteristic parameter decoded, 
and 

a picture reconstruction unit for carrying out interpolation, 
using at least one of a temporally past characteristic parameter and a 
temporally future characteristic parameter, along the time axis, for 
subsequently restoring a picture image which has not been received. 
[0017] 

An apparatus, in accordance with a seventh aspect of the present 
invention, comprises a decoder, said decoder including a decoding unit 
for receiving a bitstream, obtained on compressing/encoding a moving 
picture, and for restoring a picture image from the bitstream, and a 
picture reconstruction unit for dividing the picture image into a 
plurality of blocks, each being of a preset small size, extracting a 
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characteristic parameter from the picture image restored, in at least one 
of the blocks, deciding on whether or not interpolation along the time 
axis is to be carried out, with the use of at least one of a temporally 
past characteristic parameter and a temporally future characteristic 
5 parameter, and for subsequently restoring a picture image which has 
not been received. 
[0018] 

An apparatus, in accordance with an eighth aspect of the present 
invention, comprises a decoder, said decoder including a decoding unit 
10 for receiving a bitstream, obtained on compressing/encoding a moving 
picture, decoding at least one characteristic parameter from the 
bitstream, outputting the so decoded characteristic parameter, and for 
restoring a picture image, using the characteristic parameter decoded, 
and 

15 a picture reconstruction unit for dividing the picture image into 

a plurality of blocks, each being of a preset small size, deciding, in at 
least one of the small-sized blocks, on whether or not interpolation is 
to be carried out, with the use of at least one of a temporally past 
characteristic parameter and a temporally future characteristic 

20 parameter, and for subsequently restoring a picture image which has 
not been received. 
[0019] 

A method, in accordance with one aspect of the present 
invention, comprises a step of a decoder receiving a bitstream, obtained 
25 on compressing/encoding a moving picture, and restoring a picture 
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image from the bitstream, a step of a characteristic parameter 
extraction unit extracting a characteristic parameter from the picture 
image restored in the decoder, and a step of a picture reconstruction 
unit carrying out preset processing, with the use of a temporally past 
characteristic parameter and/or a temporally future characteristic 
parameter, for restoring a picture image which has not been received. 
[0020] 

According to the present invention, there are provided methods 
in accordance with second to eighth aspects in association with the 
apparatus in accordance with the second to eighth aspects mentioned 
above, respectively. According to the present invention, there are also 
provided, in association with the method of each of the respective 
aspects, a computer program in which the respective processing steps 
are carried out on a computer or on a processor. 

According to the present invention, the information on a 
compressed/encoded picture is received and decoded to restore a 
picture image, and a preset characteristic parameter is extracted from 
the picture image restored or from the picture information acquired in 
the course of the decoding. From the characteristic parameter and 
from the picture image restored, a picture image different from the 
restored image may be restored to enable restoration of a picture image 
which has not been received. 

MERITORIOUS EFFECT OF THE INVENTION 
[0021] 

According to the present invention, a picture which has not been 
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received may be restored on a receiving side, using a preset 
characteristic parameter. Hence, even if it is not possible to provide a 
sufficient number of frames due to, for example, a low transmission 
speed of the mobile transmission channel or on the Internet, the number 
5 of picture frames can be increased on the receiving side to enable the 
movement to be expressed sufficiently satisfactorily, thereby improving 
the quality of a moving picture. 
[0022] 

Moreover, according to the present invention, the above objects 
10 can be accomplished solely by processing on the receiving side, so that 
it is unnecessary to meddle with the transmitting side. Thus, 
according to the present invention, the pre-existing encoder or the 
pre-existing compressed/encoded stream may be used unchanged. 
[0023] 

15 Furthermore, according to the present invention, it is only 

necessary to add only certain functions on the receiving side, so that 
there is no fear of the cost increasing, while the amount of processing 
on the receiving side is also only small. 
BRIEF DESCRIPTION OF THE DRAWINGS 

20 [0024] 

Fig.l is a diagram showing the configuration of a first 
embodiment of the present invention. 

Fig. 2 is a diagram showing the configuration of a second 
embodiment of the present invention. 
25 Fig. 3 is a diagram showing the configuration of a third 
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embodiment of the present invention. 

Fig. 4 is a diagram showing the configuration of a fourth 
embodiment of the present invention. 

Fig. 5 is a diagram showing the configuration of a fifth 
5 embodiment of the present invention. 

Fig. 6 is a diagram showing the configuration of a sixth 
embodiment of the present invention. 

Fig. 7 is a diagram showing the configuration of a seventh 
embodiment of the present invention. 
10 Fig. 8 is a diagram showing the configuration of an eighth 

embodiment of the present invention. 
EXPLANATIONS OF SYMBOLS 
[0025] 

200 decoder 
15 201 receive buffer 

202 variable length decoder 

203 inverse quantizer 

204 inverse transformer 

205 frame memory 

20 206 motion compensation predictor 
207 adder 

210 characteristic parameter extractor 

211 frame memory 

212, 222, 231 moving picture reconstructor 

25 215, 230 interpolators 
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220 division-into-small-size block unit 

221 characteristic parameter extraction & decision unit 
225 division-into-small-block & decision unit 

MOST PREFERRED MODE FOR CARRYING OUT THE INVENTION 
5 [0026] Reference will now be made to the accompanying drawings for 
describing the present invention in more detail. Fig.l is a diagram 
showing the configuration of a moving picture reproducing apparatus 
according to a first embodiment of the present invention. Referring to 
Fig.l, the apparatus includes a decoder 200, a characteristic parameter 
10 extractor 210, a frame memory 211 and a moving picture reconstructor 
212. 
[0027] 

The decoder 201 includes a receive buffer 201, a variable length 
decoder 202, a inverse quantizer 203, an inverse transformer 204, a 
15 frame memory 205, a motion compensation predictor 206, and an adder 
207. 
[0028] 

The receive buffer 201 receives a bitstream, obtained on 
compressing/encoding a moving picture, and transiently stores the 

20 bitstream received. The receiving buffer then outputs the encoded 
bitstream, thus received and stored, to the variable length decoder 202. 
It is noted that, while the compression/encoding of a moving picture is 
carried out on a transmitting side, not shown, an encoder required for 
such compression/encoding may be an encoder constructed in 

25 accordance with H.261, H.263 or H.264, as ITU-T recommendations. 
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with MPEG-4, as ISO/IEC recommendations, or with other moving 

picture compression/encoding systems. 

[0029] 

The variable length decoder 202 carries out variable length 
5 decoding on a received encoded output bitstream, output from the 
receive buffer 201, and outputs the decoded quantized transform 
coefficients to the inverse quantizer 203. 
[0030] 

The inverse quantizer 203 carries out calculations for inverse 
10 quantization on the quantized transform coefficients, output from the 
variable length decoder 202, to output the resulting inverse quantized 
transform coefficients to the inverse transformer 204. 
[0031] 

The inverse transformer 204 carries out I-DCT (Inverse Discrete 
15 Cosine Transform), as an example, on the transform coefficients, output 
from the inverse quantizer 203, to output the resulting transformed 
moving picture signal to the adder 207. 
[0032] 

In the present embodiment, I-DCT is used as an inverse 
20 transform in the inverse transformer 204. However, other transforms, 
such as inverse integer transform for H.264, may, of course, be used. 
[0033] 

The frame memory 205 temporally stores a moving picture 
signal output from the adder 207. 
25 [0034] 
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The motion compensation predictor 206 executes motion 
compensation/prediction on the moving picture signal stored in the 
frame memory 205, using the characteristic parameter output from the 
variable length decoder 202. The motion compensation predictor 206 
5 outputs a moving picture signal, obtained as a result of the motion 
compensation/prediction, to the adder 207. 
[0035] 

The adder 207 adds a moving picture signal, output from the 
inverse transformer 204, to the moving picture signal output from the 
10 motion compensation predictor 206. The moving picture signal, 
obtained on addition by the adder 207, is output, as a decoder output 
signal, to the frame memories 205, 211 and to the characteristic 
parameter extractor 210. 
[0036] 

15 The characteristic parameter extractor 210 extriacts at least one 

characteristic parameter from the moving picture signal output from the 
decoder to output the so extracted characteristic parameter to the 
moving picture reconstructor 212. As the characteristic parameter, a 
motion vector, for example, may be used. 

20 [0037] 

The moving picture reconstructor 212, receiving one or both of a 
temporally past characteristic parameter and a future characteristic 
parameter, while receiving one or both of a temporally past picture and 
a future picture (decoded picture) from the frame memory 211, 
25 combines the so received picture(s) with the aforementioned 



16 

characteristic parameter(s) to perform preset processing to reproduce 
and output a moving picture frame which has not been received. The 
preset processing may, for example, be the processing of motion 
compensation/inter-frame prediction employing the motion vector. 
5 [0038] 

The method according to the first embodiment of the present 
invention is made up by the following steps, as the processing sequence. 
Meanwhile, since the method is made up of a sequence of steps 1 to 3, 
it is not shown as a flowchart. The same applies for the next 
10 following embodiments. 
[0039] 

Step 1: The decoder 200 receives a bitstream, obtained on 
compressing/encoding a moving picture, to restore a picture image from 
the bitstream received. 
15 [0040] 

Step 2: The characteristic parameter extractor 210 extracts the 
characteristic parameter from the picture image restored by the decoder 
200. 
[0041] 

20 Step 3: The moving picture reconstructor 212 applies preset 

processing, such as motion compensation/inter-frame prediction, 
employing the motion vector, with the use of the temporally past 
characteristic parameter and/or the temporally past characteristic 
parameter, to restore a picture image which has not been received. 

25 [0042] 
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The above processing may be implemented by carrying out a 
program on a computer, such as a DSP (digital signal processor), 
making up a moving picture reproducing apparatus. The same may be 
said of the embodiments as hereinafter explained. 
5 [0043] 

A second embodiment of the present invention will now be 
described. Fig. 2 is a diagram showing the configuration of the second 
embodiment of the present invention. In Fig. 2, the parts or 
components which are the same as or equivalent to those shown in 
10 Fig.l, are denoted with the same reference numerals. Referring to 
Fig. 2, the characteristic parameter extractor 210 is not used. In the 
following, only the points of difference from the above-described first 
embodiment will be described. 
[0044] 

15 Referring to Fig. 2, a characteristic parameter is taken out from 

an output of a variable length decoder 202 and routed to a moving 
picture reconstructor 212. Hence, the characteristic parameter 
extractor 210, provided in the above-described first embodiment, is 
dispensed with. 

20 [0045] 

The method according to the second embodiment of the present 
invention is made up by the following steps, as the processing 
sequence. 
[0046] 

25 Step 1: A decoder 200 receives a bitstream, obtained on 
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compressing/encoding a moving picture, and decodes at least one 
characteristic parameter from the bitstream to output the so decoded 
characteristic parameter. A picture image then is restored, using the 
so decoded characteristic parameter. 
5 [0047] 

Step 2: A moving picture reconstructor 212 carries out preset 
processing (for example, motion compensation/inter-frame prediction 
employing the motion vector), using the temporally past characteristic 
parameter and/or the temporally future characteristic parameter, to 
10 restore a picture image which has not been received. 
[0048] 

A third embodiment of the present invention will now be 
described. Fig. 3 is a diagram showing the configuration of the third 
embodiment of the present invention. In Fig. 3, the parts or 

15 components which are the same as or equivalent to those shown in 
Fig.l, are denoted with the same reference numerals. Referring to 
Fig. 3, in the present embodiment, a division-into-small-size block unit 
220 and a characteristic parameter extraction & decision unit 221 are 
provided between a decoder 200 (which is the same as one shown in the 

20 first embodiment shown in Fig.l) and a moving picture reconstructor 
222. In the following, explanation on the parts or components which 
are the same as those shown in the first embodiment of Fig.l is omitted 
from time to time and the points of difference will be described. 
[0049] 

25 The division-into-small-size block unit 220 divides the restored 
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picture image into preset small-sized blocks, and outputs the 
demarcation of each small-sized blocks. The size of the small-sized 
block may, for example, be the size of a macro-block (MB) or a size 
equal to an integer multiple of the macro-block. 
5 [0050] 

The characteristic parameter extraction & decision unit 221 
extracts a characteristic parameter in at least one small-sized block to 
output the so extracted parameter to a moving picture reconstructor 222. 
Such characteristic parameter may, for example be a motion vector. 
10 [0051] 

In at least one small-sized block, the characteristic parameter 
extraction & decision unit 221 decides, using the characteristic 
parameter, on whether or not processing in the moving picture 
reconstructor 222 is to be carried out, and accordingly outputs a 
15 decision signal. For example, the characteristic parameter extraction 
i&; decision unit 221 decides on whether the small-sized block in 
question is a dynamic region or a static region, and outputs the result 
of decision as a decision signal. 
[0052] 

20 The moving picture reconstructor 222 receives the demarcations 

of the small-sized blocks, a decision signal for at least one small-sized 
block and a characteristic parameter for at least one small-sized block. 
The moving picture reconstruction unit also receives one or both of a 
past picture and a future picture from the frame memory 211 and 

25 executes preset processing in at least one small-sized block, in 
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accordance with an input decision signal, to restore a picture image 
which has not been received. This preset processing may, for example, 
be motion compensation/inter-frame prediction employing the motion 
vector. 
5 [0053] 

The method according to the third embodiment of the present 
invention is made up by the following steps, as the processing 
sequence. 
[0054] 

10 Step 1: A decoder 200 receives a bitstream, obtained on 

compressing/encoding a moving picture, and restores a picture image 
from the bitstream. 
[0055] 

Step 2: A division-into-small-size block unit 220 divides the 
15 picture image into plural small-sized blocks, each being of a preset 
size. 
[0056] 

Step S3: The characteristic parameter extraction & decision unit 
221 extracts at least a characteristic parameter from the restored 

20 picture image, in at least one small-sized block, and outputs the so 
extracted characteristic parameter to the moving picture reconstructor 
222. The characteristic parameter extraction and decision unit decides, 
using a temporally past characteristic parameter and/or a temporally 
future characteristic parameter, on whether or not preset processing, 

25 such as motion compensation/inter-frame prediction, employing the 
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motion vector, is to be carried out, and subsequently restores a picture 

image which has not been received. 

[0057] 

A fourth embodiment of the present invention will now be 
5 described. Fig. 4 is a diagram showing the configuration of the fourth 
embodiment of the present invention. In Fig. 4, the parts or 
components which are the same as or equivalent to those shown in 
Fig.l, are denoted with the same reference numerals. In the present 
embodiment, a division-into-small-block & decision unit 225 is 

10 provided between a decoder 200 (which is the same as one shown in the 
first embodiment of Fig.l) and a moving picture reconstructor 222. In 
the following, explanation on the parts or components which are the 
same as those shown in the first and third embodiments of Figs.l and 3 
is omitted from time to time and the points of difference will be 

15 described. 
[0058] 

The division-into-small-block & decision unit 225 divides a 
restored picture image into a plural number of preset small-sized 
blocks to output demarcations of the small-sized blocks. As the size 
20 of the small-sized blocks, the size of a macro-block (MB) or the size 
equal to an integer multiple of macro-block size is used. 
[0059] 

The division-into-small-block & decision unit 225 decides on 
whether or not processing by the moving picture reconstructor 222 is to 
25 be carried out in at least one small-sized block, using the characteristic 
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parameter, and outputs a decision signal. For example, the 
division-into-small-block & decision unit 225 decides on whether or 
not the small-sized block in question is a dynamic region or a static 
region, and outputs the result of decision as a decision signal. 
[0060] 

The method according to the fourth embodiment of the present 
invention is made up by the following steps, as the processing 
sequence. 
[0061] 

Step 1: The decoder 200 receives a bitstream, obtained on 
compressing/encoding a moving picture, and restores at least one 
characteristic parameter from the bitstream to output the so restored 
parameter. The decoder restores the picture image, using the so 
decoded characteristic parameter. 
[0062] 

Step 2: The division-into-small-block & decision unit 225 
divides the picture image into a plural number of preset small-sized 
blocks. In at least one of these small-sized blocks, the moving picture 
reconstructor 222 decides, using a temporally past characteristic 
parameter and/or a temporally future characteristic parameter, on 
whether or not the preset processing, for example, motion 
compensation/inter-frame prediction, employing the motion vector, is 
to be carried out. 
[0063] 

Step 3: The moving picture reconstructor 222 receives 
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demarcations into plural small-sized blocks, a decision signal in at 
least one small-sized block, a characteristic parameter in at least one 
small-sized block, and one or both of the past picture image and the 
future picture image from the frame memory 211, to restore a picture 
image which has not been received. 
[0064] 

A fifth embodiment of the present invention will now be 
described. Fig. 5 is a diagram showing the configuration of the fifth 
embodiment of the present invention. In Fig. 5, the parts or 
components which are the same as or equivalent to those shown in 
Fig.l, are denoted with the same reference numerals. In the present 
embodiment, an interpolator 215 is provided between a characteristic 
parameter extractor 210 and a moving picture reconstructor 212 of the 
above-described first embodiment shown in Fig.l. In the following, 
explanation on the parts or components which are the same as those 
shown in the first embodiment of Fig.l is omitted from time to time 
and the points of difference will be described. 
[0065] 

The interpolator 215 receives an output of the characteristic 
parameter extractor 210, and carries out interpolation along the time 
axis, using at least one of the temporally past characteristic parameter 
and the temporally future characteristic parameter, to output the 
characteristic parameter, produced by the interpolation, to the moving 
picture reconstructor 212. As the characteristic parameter, the motion 
vector, for example, may be used. The moving picture reconstructor 
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212 executes motion prediction/inter-frame prediction, using the 
motion vector, as the characteristic parameter from the interpolator 215, 
to restore a moving picture from the past picture image and/or the 
future picture image from the frame memory 211. 
5 [0066] 

The method according to the fifth embodiment of the present 
invention is made up by the following steps, as the processing 
sequence. 
[0067] 

10 Step 1: The decoder 200 receives a bitstream, obtained on 

compressing/encoding a moving picture, and restores a picture image 
from the bit stream. 
[0068] 

Step S2: The characteristic parameter extractor 210 extracts a 
15 characteristic parameter from the picture restored by the decoder 200. 
[0069] 

Step S3: The interpolator 215 carries out interpolation, using at 
least one of the temporally past characteristic parameter and the 
temporally future characteristic parameter, along the time axis, and 
20 outputs the so interpolated characteristic parameter to the moving 
picture reconstructor 212. 
[0070] 

Step S4: The moving picture reconstructor 212 receives an 
output of the interpolator 215 (an interpolated characteristic vector) 
25 and one or both of the past picture image and the future picture image 
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from the frame memory 211 to restore a picture image which has not 

been received. 

[0071] 

A sixth embodiment of the present invention will now be 
5 described. Fig. 6 is a diagram showing the configuration of the sixth 
embodiment of the present invention. In Fig. 6, the parts or 
components which are the same as or equivalent to those shown in 
Fig.l, are denoted with the same reference numerals. In the present 
embodiment, an interpolator 215 is provided between a variable length 

10 decoder 202 of a decoder 200 and a moving picture reconstructor 212 
of the above-described first embodiment shown in Fig.l. In the 
following, the explanation on the same parts or components as those of 
the first and fifth embodiments, shown in Figs.l and 5, respectively, is 
omitted from time to time, and only the points of difference will be 

15 explained. 
[0072] 

In the present embodiment, the interpolator 215 receives a 
characteristic parameter from an output of the variable length decoder 
202. Hence, in the present embodiment, the characteristic parameter 
20 extractor 210, shown in Fig. 5, is dispended with. 
[0073] 

The method according to the sixth embodiment of the present 
invention is made up by the following steps, as the processing 
sequence. 
25 [0074] 
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Step 1: The decoder 200 receives a bitstream, obtained on 
compressing/encoding a moving picture. The decoder decodes at least 
one characteristic parameter from the above-described bitstream, and 
outputs the so decoded characteristic parameter to restore a picture 
5 image, using the decoded characteristic parameter. 
[0075] 

Step 2: The interpolator 215 acquires at least one of the 
temporally past characteristic parameter and the temporally future 
characteristic parameter and carries out interpolation using the so 
10 acquired characteristic parameter(s) along the time axis. The moving 
picture reconstructor 212 restores a picture image, which has not been 
received, based on the temporally interpolated characteristic parameter 
output from the interpolator 215. 
[0076] 

15 A seventh embodiment of the present invention will now be 

described. Fig. 7 is a diagram showing the configuration of the 
seventh embodiment of the present invention. In Fig. 7, the parts or 
components which are the same as or equivalent to those shown in 
Fig.l are denoted with the same reference numerals. In the present 

20 embodiment, there are provided, between a decoder 200 and a moving 
picture reconstructor 231, a division-into-small-size block unit 220, a 
characteristic parameter extraction & decision unit 221 and an 
interpolator 230. In the following, the explanation on the same parts 
or components as those of the first and third embodiments, shown in 

25 Figs.l and 3, respectively, is omitted from time to time, and only the 
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points of difference will be explained. 
[0077] 

The division-into-smail-block unit 220 divides a restored picture 
image into a plural number of preset small-sized blocks to output 
5 demarcations of the small-sized blocks. As the size of the small-sized 
blocks, the size of a macro-block (MB) or the size equal to an integer 
multiple of macro-block size is used. 
[0078] 

The characteristic parameter extraction & decision unit 221 
10 extracts a characteristic parameter, in at least one small-sized block, 
and outputs the so extracted characteristic parameter to the moving 
picture reconstructor 231. As typical of the characteristic parameter, 
the motion vector may be used. 
[0079] 

15 In at least one small-sized block, the characteristic parameter 

extraction & decision unit 221 decides on whether or not the processing 
in the moving picture reconstructor 231 is to be carried out, with the 
use of a characteristic parameter, and outputs a decision signal. For 
example, the characteristic parameter extraction & decision unit 221 

20 decides on whether or not the small-sized block is a dynamic one or a 
static one, and outputs the result of decision by a decision signal. 
[0080] 

The interpolator 230 receives the demarcations into small-sized 
blocks, a characteristic parameter and a decision signal, in at least one 
25 small-sized block, and carries out the interpolation, along the time axis, 
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using at least one of the temporally past characteristic parameter and 
the temporally future characteristic parameter, in accordance with the 
decision signal. 
[0081] 

The moving picture reconstructor 231 receives the demarcations 
into the small-sized blocks, the decision signal in at least one 
smalUsized block, and an output of the interpolator 230 in at least one 
small-sized block. The moving picture reconstruction unit also 
receives one or both of the past picture image and the future picture 
image from the frame memory 211. The moving picture reconstruction 
unit carries out preset processing, in at least one small-sized block, in 
accordance with the decision signal, to restore a picture frame which 
has not been received. The preset processing may, for example, be 
motion compensation/inter-frame prediction. 
[0082] 

The method according to the seventh embodiment of the present 
invention is made up by the following steps, as the processing 
sequence. 
[0083] 

Step 1: The decoder 200 receives a bitstream, obtained on 
compressing/encoding a moving picture, and restores a picture image 
from the bitstream. 
[0084] 

Step S2: The division-into-small-size block unit 220 divides the 
picture image into a plural number of preset small-sized blocks. 
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[0085] 

Step S3: The characteristic parameter extraction & decision unit 
221 extracts a characteristic parameter, from the aforementioned 
restored image, in at least one small-sized block, and decides on 
5 whether or not interpolation along the time axis is to be carried out, 
using at least one of the temporally past characteristic parameter and 
the temporally future characteristic parameter. 
[0086] 

Step S4: The moving picture reconstructor 231 receives 
10 demarcations of division into plural small-sized blocks, decision signal 
in at least one small-sized block, and the output of the interpolator 230 
in at least one small-sized block, to restore a picture image which has 
not been received. 
[0087] 

15 An eighth embodiment of the present invention will now be 

described. Fig. 8 is a diagram showing the configuration of the eighth 
embodiment of the present invention. In Fig. 8, the parts or 
components which are the same as or equivalent to those shown in 
Fig. 7 are denoted with the same reference numerals. The present 

20 embodiment includes a division-into-small-sized-section & decision 
unit 225 and an interpolator 230 between a decoder 200 and a moving 
picture reconstructor 231. In the following, the explanation on the 
same parts or components as those of the first and seventh 
embodiments, shown in Figs.l and 7, respectively, is omitted from time 

25 to time, and only the points of difference will be explained. 
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[0088] 

The division-into-small-block & decision unit 225 divides the 
restored picture image into a plural number of preset small-sized 
blocks, and outputs demarcations of the small-sized blocks. The size 
5 of the small-sized block used may, for example, be the size of a 
macro-block (MB) or the size equal to an integer multiple of the 
macro-block. 
[0089] 

In at least one small-sized block, the division-into-small-block 
10 & decision unit 225 decides, using the characteristic parameter, on 
whether or not the processing in the moving picture reconstructor 231 
is to be carried out, and accordingly outputs a decision signal. For 
example, the division-into-small-block & decision unit decides on 
whether the small-sized block in question is a dynamic area or a static 
15 area, and outputs the result of decision as a decision signal. 
[0090] 

Since the interpolator 230 receives the characteristic parameter 
from an output of the variable length decoder 202, the characteristic 
parameter extraction & decision unit 221 of the seventh embodiment, 
20 shown in Fig. 7, is dispensed with. 
[0091] 

The method according to the eighth embodiment of the present 
invention is made up by the following steps, as the processing 
sequence. 
25 [0092] 
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Step 1: The decoder 200 receives a bitstream, obtained on 
compressing/encoding a moving picture, and decodes at least one 
characteristic parameter from the bitstream to output the so decoded 
parameter. The decoder restores a picture image, using the so decoded 
5 parameter. 
[0093] 

Step S2: The division-into-small-block & decision unit 225 
divides a picture image into a plural number of preset small-sized 
blocks, and decides on whether or not interpolation is to be made along 
10 the time axis, in at least one small-sized block, using at least one of 
the temporally past characteristic parameter and the temporally future 
characteristic parameter. 
[0094] 

Step S3: The moving picture reconstructor 231 restores a picture 
15 image, not received, using the demarcations of the small-sized blocks, 
the decision signal in at least one small-sized block and at least one of 
the temporally past characteristic parameter and the temporally future 
characteristic parameter from the decoder 200. 
[0095] 

20 Although the present invention has so far been explained with 

reference to the preferred embodiments, the present invention is not 
limited to the particular configurations of these embodiments. It will 
be appreciated that the present invention may encompass various 
changes or corrections such as may readily be arrived at by those 

25 skilled in the art within the scope and the principle of the invention. 



